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Analysis  and  Design  of  Communication 
Networks  with  Memory 


by 

S.  L.  Hakimi  * 

ABSTRACT 

A  mathematical  formulation  of  the  communication  networks  with 
memory  is  presented  assuming  that  the  sources  of  traffic  are  de¬ 
terministic  but  not  necessarily  time  invariant.  The  formulations 
leads  to  a  linear  programming  problem.  Some  generalizations  and 
justifications  of  the  choice  of  the  model  are  discussed.  The  same 
basic  formulation  can  be  used  as  a  tool  for  analysis  as  well  as 
least-cost  design  or  improvement  of  an  existing  network.  Design 
of  the  memory  systems  and  its  relation  with  messages  with  priorities 
is  considered. 

Similar  concepts  are  used  to  arrive  at  an  approximate  linear 
programming  formulation  of  "street  traffic". 
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A0020-A03  (Identification  Number  NR  373-502/3-14-66  Electronics 
Branch) . 
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I. 


Introduction 


A  communication  or  traffic  network  N  is  a  set  of  n  points 

(switching  stations,  cities)  that  are  conhected  by  m  lines  (channels, 

transmission  lines,  highways).  A  convenient  model  of  such  a  system  is 

a  graph  G  with  n  vertices  (or  nodes),  v, ,  v.,  ...»  v  and  m 

i  L  n 

branches  b, ,  b_,  ...,  b  .  Each  branch  b.  is  connected  between  a 

I  i  D  1 

pair  of  distinct  vertices  v^  and  Vj.  The  vertices  and  the  branches  in 
G  correspond  to  the  stations  and  lines  in  network  N.  We  assume  that 
each  line  in  N  allows  traffic  only  in  one  direction,  (or  N  is 
unilateral).  (As  it  will  be  shown,  this  assumption  is  not  a  necessary 
part  of  the  formulation.)  Arrowheads  are  placed  on  corresponding 
branches  of  G  to  signify  the  allowable  direction  of  traffic  flow. 

With  each  branch  b^  (lsfcJm),  there  is  associated  a  real  non-negative 

* 

number  b^  which  represents  the  capacity  of  corresponding  line  in  N, 
The  capacity  of  a  branch  in  G  is  the  maximum  allowable  rate  of  flow 
in  the  corresponding  branch  in  N  (in  the  direction  of  arrowhead). 

If  the  stations  In  N  (or  vertices  in  G)  have  no  capacity  restrictions 
or  "delay  characteristics",  then,  they  merely  represent  junctions  and 
such  a  network  is  called  a  "circuit  switching  network"  or  a  communica¬ 
tion  network  with  direct  traffic  [1,2,3]  .  Traffic  handling  capability 
and  the  design  of  such  networks  have  been  widely  studied  [4-10]  .  Now, 
let  us  attach  a  real  non-negative  number  m^  to  each  vertex  v^ 

(1  -  l,2,...n)  in  G  where  represents  the  maximum  amount  of 

messages  (or  traffic)  that  can  be  stored  (or  held  up)  at  the  correspond¬ 
ing  station  of  N.  In  a  communication  network  the  number  m^  is  the 


capacity  of  the  memory  system  (or  the  capacity  of  the  warehouse)  at 
The  function  of  the  memory  system  (or  unit)  at  a  vertex  is  to  store 
the  messages  in  the  memory  unit  when  the  outgoing  lines  from  that  vertex 
are  busy  (or  flooded  to  the  capacity).  Such  a  network  is  called  a 
network  with  "message  and  circuit  switching"  or  a  store- and- forward 
communication  network  [1,3]  .  We  will  refer  to  them  as  a  communication 
network  with  memory.  Although  some  engineering  aspects  of  this  type  of 
networks  have  been  studied,  no  general  method  for  the  analysis  and 
design  of  such  networks  is  available.  A  description  of  a  general 
formulation  for  the  communication  networks  with  memory  is  the  main 
result  of  this  paper.  This  formulation  leads  to  an  extremely  large 
linear  program;  however,  this  linear  program  has  a  special  structure 
which  enables  one  to  take  advantage  of  Danzig-Wolfe  [11,12]  decomposi¬ 
tion  principle  to,partially, alleviate  the  computational  difficulty. 

Also,  it  is  shown  that  one  can  obtain  a  feasible  solution  to  the 
design  problem  by  a  direct  method  which  leads  to  suboptimal  results. 

II.  Flow  Model  Formulation 

Consider  a  communication  network  N  represented  by  a  weighted 
directed  graph  G  with  n  vertices  and  m  branches.  The  weight  of 
the  branch  b^  is  b^  (i  ■  l,2,...m)  which  represents  the  capacity 
of  the  corresponding  line  (channel)  in  N,  and  the  weight  of  the  vertex 
v^  is  m^  (i  ■  l,2,...n)  which  represents  the  capacity  of  memory 
system  located  at  the  corresponding  station  in  N.  We  construct  a 
directed  graph  G*  from  G  as  follows:  We  split  each  vertex  v^  in 
G  into  two  vertices  v^  and  v^  in  G*.  All  of  the  branches  whose 
arrowheads  are  toward  vertex  ;  v^  in  G  are  connected  to  vertex  v^ 
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in  G*  rr.c*  'I1  o£  the  branches  whose  arrowheads  are  away  from  v^  in 
G  are  connected  to  v^  in  G*.  The  branches  in  G*  are  labelled  as  the 
corresponding  branches  were  in  G.  Let  us  assume  that  the  message 
(or  traffic)  flow  rate  at  the  time  t  due  to  the  messages  originating 
from  v^  in  branch  bj  in  G  (or  G*)  is  represented  by  ^  (t)  (Ujsm  and 
l£i£n).  Let  the  sum  of  the  corresponding  flow  rates  entering  vertex 
Vj  In  G  (or  v^  in  G*)  at  time  t  be  x^(t)  and  the  sum  of  flows 
leaving  v^  in  G  (or  v^  In  G*)  at  time  t  be  y^CO  (Is  i  and  Jsn). 
Figure  1(a)  represents  typical  vertex  v^  of  G  and  Fig.  1(b)  represents 
the  splitting  of  corresponding  vertex  in  G*.  If  there  is  no  memory  at 
Vj  (i.e.,  iij  ■  0),  then  x^j(t)  =  y^j(t)  for  all  t.  However  if  mj>0, 
then  at  some  Interval  of  time  x£j  (t^y^j(t)  when  the  surplus  incoming 
flows  are  accumulated  in  memory,  and  in  another  Interval  x^j(t)^^j(t) 
when  the  content  of  the  memory  is  decreased. 

We  first  consider  the  situation  when  all  messages  originate  at 
one  vertex,  say  v^,  called  the  "source."  (This  case  corresponds  to 
the  "single-commodity"  problem  in  network  flow  theory  [7,  10]).  The 
destinations  of  these  messages  could  be  at  any  or  all  vertices 
v12’  v22’  ***vn2*  ca^^e<*  fche  "sinks."  Let  s^(t)  be  the  rate  of  the 

* 

production  of  messages  at  the  source  which  is  connected  to  v^  in  G  and  let 
ull(t)>  u^CO.  ...,  uin(t)  be  the  rates  of  the  arrival  of  messages  at 
the  sinks  or  the  vertices  v^»  '*22*  ***v2n*  resPect*vely*» 

*  Usually  one  assumes  that  each  source  produces  messages  that  are 
destined  for  a  single  sink  [ 7,  10] ;  thus  one  might  have  up  to  n  sources 
connected  to  a  single  vertex.  For  the  purpose  of  design,  there  is  no 
reason  to  make  such  a  distinction.  However,  if  we  are  also  to  find  a 
routing  policy,  then  we  must  distlnquish  between  the  sources  connected 
to  a  single  vertex. 
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(Usually  s^(t)  and  u^(l),  u^(t),  (t)  -re  random  processes; 

here,  we  might  consider  these  functions  to  be  expected  values  of  the 
corresponding  random  variables  at  each  instant  of  time).  We  refer  to 
the  source  wnose  output  is  s^(t)  as  the  source  s^. 

At  each  vertex  v.^(or  v^)  of  G*  (l<j<n),  one  may  write  a  linear 
algebraic  equation  which  expresses  that  the  sum  of  flows  entering 
v^  (or  leaving  v due  to  the  source  is  equal  to  x^(t)  (or  y,(t)). 
In  the  matrix  form,  v/e  may  write  for  all  t 


r  \ 
^Cfi) 

^(t) 

A1 

=  X^(t)  and  A2 

s.Ct) 

V  1  J 

uL(t) 

^  / 

=  XL(t) 


(1) 


where  column  vectors  Z^(t)  =[zj^(t)  z12(t)  ....  zlm(t)],  X^Ct)  ~ 

[xu(t)x,2(t) - xln(t)]',  Yt(t)  «[  yu(t)  y12(t)  yln(t)];,  and 

JJ^(t)  =[  u^(t)  u^CO  uln^t^’  A1  -r!<*  ^2  arC  "zero  ant*  one"  matrices 
and  their  form  is  self  explanatory.  In  addition  to  the  system  of  equa¬ 
tions  (1),  we  need  some  inequality  constraints  conccring  the  capacities 
of  the  lines  and  memory  units.  The  first  system  of  inequalities  is  an 
obvious  one. 

Or:  Z  (t)<  B  for  all  t  - where  B  =  <fb,  b„  . . .  b  3  (2) 

That  is,  the  capacity  of  each  link  limits  the  flow  through  the  link. 

To  arrive  at  the  second  system  of  inequalities,  let  us  assume  at  time 

t  »o  jr^  units  of  messages  due  to  s^  are  stored  in  nr  (lr:i<n).  Let 

/ 

column  vector  =  Cr^ ^2*  *  ’ rln^  ca^ec*  t*ie  ini c iti  1  state  vector. 

We  note  that  the  function  of  memory  vas  to  store  the  surplus  messages 
at  each  vertex.  With  this  in  mind,  we  may  write  for  each  instant  of 
t  ime  t 

0<  +  j*  [Xl(t)  -  (r )]  dT<  M  (3) 

where  M  =  fm,m„. .  .ml  and  0  is  a  zero  column  vector.  The  above  inequalities 
—  1  2  n  — 
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express  that'  ail  no  Instant  of  time  the  accumulated  sum  of  message  stored 
in  a  vertex  can  exceed  the  capacity  of  that  vertex  nor  can  it  be 

negative. 

Before  we  discuss  the  formulation  of  the  objective  function, we 
generalize  (l)-(3)  to  the  case  of  many  sources  (or  many  commodities). 
Suppose  to  each  vertex  v^  in  G  (or  v^  in  G*)  a  source  of 
messages  is  connected  whose  output  as  a  function  of  time  is  s^(t). 
Corresponding  to  this  source,  we  are  given  a  sink  vector  U^(t)  whose 
components  represent  the  rate  of  arrival  of  messages  originating  from 
the  source  connected  to  v^  at  the  different  vertices  of  G.  Note 
that  we  also  need  to  have  for  each  source  s^  a  separate  Initial 
state  vector  R^.  Then,  for  each  single  source  we  may  write  a  set  of 
constraints  in  the  form  of  (1)  as  follows 


• 

\  <t) 

f  ‘  \ 

<t) 

A1 

■  Xt  (t)  and  A2 

a,  (t) 
^  1 

ut  (O 

1±  <o 


(4) 


for  1  ■  1,2,  ...,  n  and  all  t,  where  Z^(t)  =*[  z^  -  -  -  z^]  :  , 

X^  *  [x^  — -  *£n]  »  and  Y^  *  [y^  ^in^*  Constraint  (2)  becomes 


E  Z  (t)  s  B*  ,  Z  (t)  2  0  for  1  -  1,2,  ...,  n  and  all  t  (5) 
i-1  1  “ 

and  finally  the  constraints  given  by  (3)  become 
if  t 


and 


E  £  Rt  +  J  Cj^Or)  -  Y^t)]  dr}s  M 
o 

t 

^  [  X^r)  -  Y^t)]  4r  ij,  for  i  =  l,2,...n  and  all  t.  (6) 


In  a  ^linear}  programming  problem  (4),  (5),  and  (6)  represent 
constraints  and  to  complete  the  formulation  we  need  an  objective 


function.  However,  to  do  this,  we  must  specify  exactly  what  the 
problem  is?  We  define  three  separate  problems  and  show  that  each 
problem  leads  to  a  different  objective  function,  but  the  constraints 
remain  unaltered. 


Problem  1.  Optimum  Design:  We  are  given  G  (the  desired  structure 

of  the  network)  and  the  source  output  functions  s^(t),  a  sink  vector 

U±(t),  and  initial  state  vectors  for  i  =  1,2,  ...,  n  and  all  t. 

/ 

We  are  also  given  two  column  vectors  C  =  fc,  ,  c_,  ...  c  ")  and  K  ** 

—  w  1  2  nr  — 

/ 

0^,  k^,  ...  k^}  where  c^  and  k^  are  the  cost  per  unit  capacity 
of  branch  b^  and  the  memory  unit  m^,  respectively,  i  =  1,2,  ...  n  (or  m). 
We  would  like  to  find  the  branch  capacity  vector  B*  and  the  memory 
capacity  vector  M  such  that  flow  requirements  are  satisfied  in  the 
finite  interval  [0,  T  ]  and  overall  cost  is  minimum.  This  problem 
may  be  expressed  as  follows:  find  JB*  and  M  subject  to  constraints 
(4)  through  (6)  for  all  t  in  the  interval  [ 0,  T]  such  that 


C*  B*  +  Kt  M  (7) 

is  minimized.  It  should  be  noted  that,  for  this  problem  to  be  solvable 

the  following  condition  must  be  satisfied. 

T  T 

r  n  n  f 

l  s  (t)dt  +  £  r  a  E  l  u  (t)  dt  for  i  =  1,2,...,  n.  (8) 

J  1  j=l  j=i  J 

o  J  J  o 


where  r^  and  u^(t)  are  the  jth  components  of  and  U^(t). 


Problem  2.  Improvement  of  an  Existing  Network:  The  problem  is  to  make 

a  minimum  cost  modification  of  the  present  system,  to  make  it  capable 

of  handling  heavier  traffic.  Here  G  and  present  capacities  B£*  d 

M  and  initial  state  vectors  R,  are  given  (l^i<n).  In  addition  we 
~P 

are  given  a  desired  flow  specifications  s^(t)  and  U^(t)  (1^  is  n). 

We  want  to  find  M  and  B*  such  that  these  flows  can  be  attained  in 
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the  finite  interval.  [  0,  T]  and  overall  cost  is  a  minimum.  In  short, 
the  problem  may  be  stated  as:  find  _B*  and  M  subject  to  constraints 
(4)  through  (6)  for  all  t  in  [  0,  T  ]  such  that 

CC  (B*  -  B*)  +  Kfc  (M  -  Mp)  (9) 

is  minimized.  Here  we  must  add  two  additional  side  conditions  B*  s  b* 

_p 

and  M  £  M  .  Vectors  C  and  K  are  defined  as  in  Problem  1.  The 

_p  ~ 

problem  again  is  solvable  if  and  only  if  the  given  specifications 
satisfy  (8). 

Problem  3.  Evaluation  of  the  Network  Traffic  Handling  Capability: 

We  would  like  to  know  what  is  the  maximum  flow  handling  capacity  of  a 
network.  A  way  to  formulate  the  problem  is  as  follows:  We  assume  we 
are  given  a  network  N,  thus  a  graph  G,  and  its  capacity  vectors  B* 
and  M  and  initial  state  vectors  R.  ,  R„,  R  .  We  are  also  given 

n  sources  of  messages,  but  the  corresponding  sink  vectors  are  not 


completely  specified.  We  would  like  to  maximize 


i 

m  m  s- 

E  d  £  e  \  u 

i-1  J 


,(t)  dt 


(e^'s  and  d^'s  arc  0's  or  l's  and  they  depend  upon  the  choice  of 

the  desired  subset  of  flows  to  be  maximized  and  u_  (t)  is  the  jth 

component  of  U^(t))  subject  to  the  constraints  (4),  (5),  and  (6) 

and  the  constraint  expressed  by  (8).  We  might  like  to  add  constraints 

such  as  U, (t)  ^  U  for  i  =  1,2,...,  n  and  all  t  in  the  interval  [  0,  T] 
— i  -io 

where  U.  are  given  fixed  vectors.  However,  addition  of  such  con- 
— io 

straints  may  make  the  problem  unsolvable;  that  is  the  flow  require¬ 
ments  may  not  be  feasible  (or  attainable)  L  7]  . 


III.  Computational  Aspects 

To  :.olve  any  of  the  three  problems  discussed  in  the  previous 


section  by  a  digital  computer,  we  must  quantize  tine. 


So,  we  assume 


8 


t  is  a  discref-p  variable  and  we  replace  all  of  the  integrals  by  their 

equivalent  summations.  Then,  all  constraints  and  objective  functions 

become  clearly  linear  algebraic  equations  and  thus  they  are  all 

solvable  by  linear  programming  methods.  The  number  of  constraints  In 

each  problem  in  a  practical  situation  may  be  exceedingly  large. 

However,  the  constraints  have  a  special  structure,  which  makes  it 

possible  to  use  the  Dantzig-Wolfe  decomposition  principle  [11,  12];  thus 

we  can  break  the  large  linear  program  into  many  smaller  ones.  With  this 

4 

idea  in  mind,  it  is  the  feeling  of  the  author  that  up  to  10  con¬ 
straints  can  be  handled  with  the  present  day  digital  computers.  There 
are  a  number  of  questions  that  arise  in  connection  with  the  design 
problem. 

(i)  It  is  clear  that  the  choice  of  "linear  cost,"  as  implied  by  (7), 
is  not  a  practical  one  but  was  made  to  simplify  the  computation.  A 
more  practical  choice  is  to  pick  the  cost  of  b  units  of  capacity 
(be  it  memory  or  channel  capacity)  as  a  fixed  cost  plus  a  linear  cost 
proportional  to  b.  To  do  this,  we  replace  objective  function  (7)  by 

C(B*)  +  K(M)  (11) 


and  the  functions  C(B*)  and  K(M)  are  scalar  valued  functions  of  vectors 
B*  and  M  and  are  defined  by 

m  n 

C(B*)  -  fc  cL  (b*)  and  K(M)  -  £  k^)  (12) 

i=l  i=l 

where  the  functions  c^(b*)  and  k^(m^)  are  defined  as 


cibi  + 


Pi  ,  if  bA  >  0 


ci<bi> 


i  ,  if  b  -  0 

C  k^m^  +  ,  if  m^  >  0 


W 


,  if  ra.  -  0 


(13) 


(14) 
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and  and  q^  are  initial  costs  of  branch  and  the  memory  unit 

m^.  Such  a  generalization  although  theoretically  possible  computation¬ 
ally  is  substantially  more  difficult  [l3,14] 

(ii)  How  does  one  choose  the  original  topology  or  structure  of  the 
network?  The  choice  may  partially  be  made  by  some  engineering 
considerations.  But  it  is  also  conceivable  that  one  might  base  the 
formulation  on  a  complete  graph  (a  graph  in  which  there  is  a  branch 
connecting  every  pair  of  distinct  vertices).  Then,  using  (11)  as  an 
objective  function,  it  is  likely  that  capacities  of  many  branches  and 
memory  units  will  be  zero.  In  any  case,  an  optimum  choice  will  be 
made.  One  might  alternately  try  the  original  objective  function  (7) 
and  solve  the  problem,  and  then,  set  to  zero  the  capacities  of  those 
branches  and  memory  units  which  are  small  and  repeat  the  problem 
again.  This  procedure  may  not  lead  to  the  optimum  results,  but  it 
will  certainly  be  better  than  an  arbitrary  choice. 

(iii)  How  docs  one  choose  the  initial  state  vectors  R, ,  R„,  ....  R  ? 

—1  —  n 

This  question  is  related  to  the  choice  of  length  of  period  T  in  a 
design  problem.  In  the  sense  that  if  one  is  willing  to  take  T  to 
be  sufficiently  large,  it  is  perfectly  acceptable  to  set  R^  =  0  for 
i  3  1,  2,  ...,  n.  Most  sources  of  traffic  have  a  periodic  nature. 

It  is  reasonable  to  assume  that  the  content  of  memory  reaches  a  "steady 
state"  after  the  lapse  of  several  periods.  Once  this  "steady  state" 
is  reached,  then  we  want  to  make  sure  that  the  designed  network  is 
capable  of  handling  the  traffic  that  is  forced  into  it.  Gale  [15] 
and  later  Frank  [16]  study  a  similar  problem  in  great  details  in 
connection  with  transient  flows  in  communication  networks  with  delay, 
but  no  memory.  (See  the  discussion  at  the  end  of  this  section). 

(iv)  What  does  one  do  if  the  communication  network  is  not  unilateral 
in  nature?  This  question  fortunately  can  be  answered  easily.  One  can 
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replace  each  branch  in  G  whose  capacity  is  b^  by  two  parallel 

branches  b..  and  b.„  in  G,  with  arrowheads  placed  on  them  in 
opposite  directions.  Then  consider  resulting  directed  graph  as  a 
model  of  our  communication  network.  If  we  let  the  capacity  of  b^  = 
b^  and  capacity  of  b^  =  b^»  then  in  each  of  the  problems  discussed 
in  Section  II,  one  must  add  another  constraint 

bil  +  bi2  *  b*  *  1  "  2»  ••••  ra  (15) 


Because  of  the  computational  difficulties  one  encounters  in  the 
solution  of  large  linear  programs,  it  is  often  valuable  to  have  a 
feasible  non-optimum  solution  [ll]  .  Here,  we  will  give  a  procedure 
for  the  design  problem  (Problem  1)  which  leads  to  a  "sub-optimal" 
solution  without  any  serious  computational  difficulties.  For  the 
sake  of  the  present  discussion,  we  assume  that  the  messages  from  each 
source  lead  to  one  destination;  thus,  one  might  have  up  to  n  sources 
connected  to  the  same  vertex. 

Let  s|(t)  be  the  rate  of  the  flow  of  the  messages  which  are 
destined  for  vertex  v^  and  are  produced  by  a  source  which  is  connected 
to  vertex  v^  (i,j  =  1,2,...,  n) .  Such  a  source  will  be  called  source 
s".  Let  s|(t)  be  a  periodic  function  of  period  T,  and  let 


'i  *  T  I 


sj(t> 


dt 


for  i, j  —  1,2,...,  n. 


(16) 


o 

Let  c^  be  the  cost  per  unit  capacity  of  link  [path)  between  vertices 
v^  and  Vj  (  1  ^i,j  5  n) .  We  assume  c|  =  0,  and  c|, (i  rj,  i,j  = 
is  computed  by  finding  the  shortest  path  between  vertices  v^  and 
in  graph  G  when  the  weight  of  branch  b^  is  equal  to  c^,(k  =  1,2, 
Let  k^  be  the  cost  per  unit  capacity  of  the  memory  unit  m^.  The 
cost  of  providing  sufficient  link  (channel)  capacity  to  be  able  to 


1,2,... 


. . . ,  m)  . 


n)j 
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directly  forward  the  messages  produced  by  the  source  s|  is 

J 


hi  ■  ci [ 


sup 

0<t<T 


s|(t) 


]  for  i,j  =  1,2, 


n. 


(17) 


On  the  other  hand,  if  we  use  store  and  forward  method  of  transmission, 
it  will  cost  no  more  than  t 

Kij  "  Ci  ai  +  ki£ri(0)  +  sup  j”  [_  s^(f)  -  a|]  dT| 

0  St  £T  o 


for  i,J  *  1,  2,  ....  n. 

Thus,  for  the  source  s|,  a  decision  in  favor  of  direct  traffic  is 
made  if 


(18) 


min  [L  ,  3  =  j ;  1,  j =  1,  2,  n  (19) 

otherwise,  the  store-forward  method  is  preferred.  Clearly  this  method 
can  be  carried  out  for  each  source  separately  and  the  overall  cost  of 
the  network  is 

n 

E  min  [  L  ,  K  ]  (20) 

l,j=l 

It  should  be  noted  that  the  second  term  in  (18)  is  identified  with 

the  cost  of  memory  requirement  for  the  source  s^.  Thus,  we  may  write 

t  i 

m|  =  r|(0)  +  sup  ^  Cs|(t)  -  a|  ]  dr  (21) 

0  £  t  £  T  o 

Where  r|(0)  is  the  initial  content  of  that  memory  unit.  Due  to  the 
choice  of  output  flow  a^  of  the  memory  unit,  r|(0)  =  r|(T),  thus  the 
content  of  the  memory  is  in  a  "steady-state"  condition  regardless  of 
its  value.  However,  in  a  design  problem  one  is  not  usually  given  the 
initial  content  r|(0)  of  the  memory  and  it  is  up  to  the  designer  to 
make  a  judicious  choice.  To  do  this,  we  must  remember  that  r|(0) 
must  be  chosen  such  that  the  following  condition  is  satisfied  for  all 


t  in [  0, T  ]  .  t 

rj.(0)  +  j  [  sJ(t)  -  aj]  dT£  0 
o 


(22) 


12 


Since  the  smaller  r^(0)  the  lesser  the  cost  of  the  memory  unit,  the 


best  choice  for  r.(0)  is 
1 

r|(0)  =  -  inf 


^  [s|(t  )  -  aj  ]  dT 


(23) 


0  ^t  <1  o 

which  is  a  positive  number  because  a|  is  the  average  value  of  s|(t). 


IV.  Design  Considerations  of  Memory  Systems 


In  practical  situations,  the  messages  flowing  through  the  network 


may  have  different  priorities.  Let  us  assume,  we  have  h  classes  of 


messages,  where  messages  in  class  one  have  the  highest  priority  and  the 


messages  in  class  two  have  the  next  highest  priority  and  so  forth. 


Since  the  transit  time  through  the  channels  is  assumed  to  be  negligible, 


we  may  require  that  the  messages  as  they  arrive  in  a  memory  unit  should 


be  processed  in  the  order  of  their  priorities.  Two  possible  ways  of 


designing  a  memory  unit  to  handle  such  traffic  comes  to  mind:  "parallel" 


or  "series".  Typical  examples  of  such  designs  are  shown  in  Figs.  1.2a 


and  1.2b.  We  shall  first  discuss  the  parallel  model  and  then  extend 


the  results  to  the  series  case. 


Assume  that  the  messages  arrive  at  vertex  at  the  rate  x^(t), 

and  that  x^(t),  x^(t),  •••>  (t)  are  the  rates  of  the  first, 

n 

second  ...  and  hth  priority  classes.  We  have,  £  x..(t)  ^x.Ct). 

k=l  1  1 

The  kth  priority  messages  are  stored  in  the  memory  unit  designated 


by  (the  box)  m.,  and  they  leave  tljat  box  at  the  rate  of  y,.(t) 

1  h  1 

(l^k^h).  We  also  have  E  y.,  (t)  “  y4(t).  As  before,  we  assume 

k=l  1K  1 

that  m^k  also  represent  the  capacity  of  the  memory  unit  m^> 
(lsi^n,  l^k^h).  Let  t^  be  a  given  number  which  represents  the 
maximum  length  of  time  that  a  message  stored  in  m.,  is  allowed  to 


remain  there  (Uiin,  l^k^h).  (One  expects  that  tiic>ti  k  +1* 

h-1).  Let  r^(t)  represent 


for  i  =  1,  2,  . . . , 


n  and  k  =  1,  2,  . . . , 
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the  messv-.  contone  of  m..  at  time  t.  To  ensure  that  these  messages 

lk 

will  not  remain  in  m,,  longer  than  t..  units  of  time,  we  must  have 

ik  °  ik  * 

t  +  t.. 

c  ik 

rlfc(t)  ^  J  yik^T^  dT  for  1  =  1>2>  ***n  •  k  =  l»2,...h  and  all  t  (24) 


We  will  now  attempt  a  general  formulation  for  the  design  of  communication 
networks  with  memory  and  different  priority  messages.  We  need  to  define 
the  notation. 


Let  s^j(t)  be  the  output  rate  of  jth  priority  messages  from 
the  source  connected  to  at  time  t  and  let  U^(t)  be  the  sink 

vector  of  these  messages  at  time  t.  Let  the  vector  Z^(t)  represent 
the  rates  of  flows  at  time  t  in  the  branches  of  G  (or  G*)  due  to 
the  jth  priority  messages  originating  from  the  source  s^.  Let  the 
vectors  X^(t)  (and  Y^(t))  be  vectors  whose  kth  component  repre¬ 
sents  the  rate  of  flow  into  (and  out  of)  memory  unit  due  to  the 

jth  priority  messages  originating  from  the  source  s^.  Let  the  state 
vector  R^j  be  a  vector  whose  kth  component  represent  the  content  of 


the  memory  unit 


due  to  jth  priority  messages  originating  from 


s^  at  the  time  t  =*  0.  Let  column  vector  Mj  be  defined  as 

* 

— j  ~  Cm].j  ra2j  ***  mnj^  ’ 

Then,  we  may  write  for  each  t  in  a  given  interval  [  0,T  ] 


2iJ(0 


S  .  .  (t) 

1J 


=  X.j(t)  and  A2 


V*> 


Vl>. 


=vtj(t)  (25) 


for  i  =  1,  2,  ...,  n  and  j  =  1,  2,  ...,  h 
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We  must  have  t'ue  branch  capacity  constraint 


n  h  * 

E  E  Z  (t)  *  B  and  Z  (t)  £  ft 
1-1  j-1  J 


for  1  -  l,  2,  . n  and  j  -  l,  2,  . ..,  h 


and  memory  capacity  constraints 


E  R. . •  + 


\  E  [X^Cr)  -  YtJ(r)]  dr  ^  Mj 


J  —  1,  2,  . . . ,  h 


e 

Rlj  +  f  Cx£j  (t)  -  dr  Z  2 


for  1  ■  1,  2,  ...  n  and  J  -  1,  2,  ...  h 
and  the  maximum  allowable  delay  constraint  (23),  which  might  be  rewritten 


vl 


Cxik(T)  -  ylk(T)]dr  * 


r*+tlk 

\  ylk 

^t 


(t)  dT 


for  1-1,  2,  ...n  and  k  -  l,  2,  ...h 


where  r^k,  xikCO,  and  y^(t)  are  the  1th  components  of  vectors 


E  R  .  ,  E  X  .  (t)  ,  and  E  Y..  (t)  ,  respectively. 

j-1  j-1  J-1  J 

The  objective  function  in  the  case  of  the  design  (linear  cost)  is  to 

t  *  ^  t 

minimize  C  B  +  E  K*  M  (29) 

j-l  ”J 

where  the  jth  component  Kj  is  the  cost  per  unit  capacity  of  memory 
unit  m^j  and  as  before  jth  component  of  C  is  the  cost  per  unit 
capacity  of  branch  b^. 


It  Is  possible  to  reformulate  the  communication  network  with  h 
levels  of  priorities  based  on  the  series  memory  model  (see,  Fig.  2b). 

To  do  this,  let  r^  be  the  content  of  memory  uni  ‘  \j  at  c  - 0 

ic 

and  let  x^(t)  and  (t)  be  the  input  and  the  output  flow  rates  of 
the  memory  unit  m^  at  time  t.  Constraints  (25)  and  (26)  remain  in¬ 
tact  and  we  must  replace  (27)  and  (28)  by 


0  £  r, 


t 

kj  +  J 


(T)  +  yk,j+l(T)  '  ykj(r)]  dT  S  “ 


k  ■  1,  2,  ...,  n;  j  *  1,  2,  h  and  all  t 


rkj  + 


t 

)  V°  +  ykj  +  i<T)  ■  ykj(T)  dT 


t  +  t,  . 

f  *kJ 

\  y  u  <0  dt 


k  =  1,2,  ...,  n;  j  =*  1,2,  ...»  h  and  all  t 


where  y^  +  ^(t)  =  0.  We  may  compute  t^  from  the  given  t^ 


recursively  as  follows 


=  fckj  "  A  Cki  *  k  =  l»  2’  •••'  n;  j  =  l*  2’  h  (32) 


where  t,  =0 
ko 


In  addition  we  must  add  that  for  each  j  (l£j£n) 


x,  (t)  =  kth  component  of  E  X, .(t)  f°r  k  3  1>  2,  ...,  n.  (33) 

kJ  i=l 

« 

*  n  h 

y,  .  (t)  =  kth  component  of  £  E  Y, .(t)  (34) 

kl  i=l  j»l  J 


The  objective  function  will  be  to 


t  *  n  h 

minimize  C  B  +  E  E  k, ,  m. 


i=i  A  " 


To  illustrate  the  number  of  constraints  involved  in  these  formula¬ 


tions,  suppose  m  is  the  number  of  branches,  n  is  the  number  of 
vertices,  h  is  the  number  of  priority  levels,  and  T  is  the  time 
that  the  communication  network  is  under  consideration.  If  we  assume 
that  t  assumes  values  at  integral  units  of  time,  then  the  number  of 
constraints  for  the  formulation  with  parallel  memory  (Fig.  2a)  is 
given  by 

3n2hT  +  mT  +  nhmT  +  2nhT  (36) 

which  could  be  an  extremely  large  number.* 

V.  An  Approximate  Model  of  Highway  or  Street  Traffic 

To  develop  an  accurate  model  and  a  general  formulation  of  street 
traffic  is  extremely  difficult  [17].  In  this  section,  we  will  present 
an  approximate  formulation  of  street  traffic  leading  to  a  large  linear 
program.  Let  a  directed  graph  G  represent  a  highway  or  transporta¬ 
tion  network  N.  Let  the  branches  and  vertices  of  G  represent  streets 
(or  highways)  and  street  intersections  (or  junctions)  of  N,  respectively. 
If  a  street  (or  highway)  can  handle  traffic  in  both  directions,  then 
this  is  represented  in  G  by  two  directed  branches  in  "parallel", 

(i.e.,  two  branches  connected  between  the  same  pair  of  vertices),  whose 
arrowheads  are  in  opposite  directions.  Network  N  could  be  considered 
to  be  ten  square  city  blocks,  or  a  highway  transportation  network 
interconnecting  100  cities.  The  effect  of  remaining  part  of  this  net¬ 
work  is  reflected  into  network  N  through  the  n  sources  and  sinks 
of  traffic  connected  to  N  (or  graph  G).  Let  G  have  m  branches 
and  n  vertices.  As  before,  we  assume  we  have  n  sources  of  traffic 
whose  output  rates  as  functions  of  time  are  s^(t),  S2(t),  ...,  sn(t) 


kj  » 


*  In  this  formulation,  we  must  be  given  y,  .  (t)  for  0  <  t  £  t 

KJ 

(Hk^n,  1  £  j  <:  h) 
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which  are  connected  to  the  vertices  v_ ,  v„,  ...,  v  of  G.  Correspond- 
ing  to  each  source  there  is  sink  column  n-vector  U^(t)  =» 

[u*(t)  u*(t)  ....  u*(t)]’  where  u*(t)  is  the  rate  of  arrival  of 

traffic  at  vertex  v^,  due  to  traffic  originating  from  the  source  s^, 
as  a  function  of  time.  Let  us  assume  that  it  takes  Tj  units  of  time 
for  a  car  to  travel  from  an  end  of  (tail  of  the  arrow)  branch  bj  to 
the  other  end  (head  of  the  arrow)  (l£j£m).  Let  x*(t)  represent  the 
rate  of  traffic  at  time  t  at  the  tail  end  of  the  branch  b^  due  to 
the  source  s^.  Let  z*(t)  be  the  traffic  at  the  head  of  branch  b^ 
at  time  t  due  to  the  source  s^  (see,  Fig.  3).  We  will  assume 

zj(t)  «  xj(t  +  r j)  for  i  »  1,  2,  ... ,  n;  j  ■  1,  2,  . . . ,  m  and  all  t 

At  the  "head  end"  of  branch  bj ,  the  traffic  flow  in  b^  enters  a 

junction  or  vertex.  Since  at  a  junction,  one  might  have  a  stop  sign 

(or  stop  light),  we  assime  the  traffic  flow  z*(t)  itself  does  not 

necessarily  flow  into  this  junction.  But  zj(t)  enters  a  holding  box 

whose  output  y*(t)  enters  the  intersection  (or  junction)  and  whose 

initial  content  doe  to  s^  is  rj(0).  This  assumption  will  lead  to 

the  following  equation 
t 


rj(0)  + 


(t)  -  Yj(t)  ]  dr  £  0  for  i  *  1,2,...,  n;  j  =  1,2,  ...,m 


and  all  t. 


(38) 


Since  the  traffic  may  not  be  allowed  to  back  up  beyond  certain 
limits,  we  have 


n  ,  |  |  ^  i 

E  tAO)  +  \  [E  z*(t)  -  E  y,(r)] 

i=l  J  J  i-1  J  i»l  J 


dt  *  M. 


j  ■  1,  2,  ...,  m  and  all  t. 


(39) 


(37) 


Assuming  branch  has  capacity  b^  ,  we  have  a  constraint 


n 


i  * 

E  x  (t)  £  b  for  j  =  1,  2,  m  and  all  t 

i=l  1  J 

and  we  also  have 


(40) 


x*(t)  s  0  and  y*(t)  £  0  for  i  =  1,  2,  n;  j  =  1,  2,  , m 

J  J 


and  all  t 


(41) 


It  should  be  noted  that  in  a  physical  highway  traffic  problem,  y^(t) 
is  zero  at  certain  intervals  of  time  because  the  traffic  lights  are 
periodically  red.  This  type  of  consideration,  would  make  the  problem 
substantially  more  difficult.  Here,  we  assume  yj(t)  represents  an 
average  value  taken  over  one  or  more  cycles  of  the  traffic  light. 

The  next  step  in  our  formulation  is  to  consider  the  traffic  flow 
at  each  junction.  We  first  define  for  each  vertex  v^,  (j  =  1 , 2, . . . ,  n) , 
two  sets  of  integers: 

Oj  =>  |  k  |  b^  is  incident  at  v^  with  arrowhead  toward  Vj 

3  I  ^  *s  inc^ent  at  vj  with  arrowheads  away  from 

By  Yp(t)»  pectfj,  we  mean  the  traffic  flow  entering  vertex  (or  junction) 
v,  on  branch  b  due  to  the  source  s . .  Let  y*  (t),  p  e  or.  and 

j  p  i  pq  J 

q  e  Pj,  be  that  portion  of  y*(t)  which  enters  the  branch  b^.  Thus  we  have 

u*  (t)  +  E  y*  (t)  =  y*(t),  pear.,  and  i,j  =  1,  2,  ...,  n  and  all  t 
JP  n  p  ft  ”  J 

q  e  pj  (42) 

where  the  summation  is  over  all  integers  in  P^  and  u^(t)  represent 

that  portion  of  y*(t)  that  flows  into  the  sink  at  vertex  Vj. 

We  must  also  add 

£  y*  (t)  =  xj(t),  for  qep  ,  i,j  =  1,  2,  ...,  n,  and  i  ^  j 

p  c  Oj  "  -* 


(44) 


i  a  i 

ypq(t)  +  Si(t)  =  Xq(t)  *  for  qePj*  1  =  J  "  l>  2>  •••»  n 
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where  sj(t)  is  the  portion  of  sJ,(t)  which  is  entering  branch 

b  (qep .)  and, 

q  J 

£  sj(t)  **  s.(t)  i  -  1,  2 . n  and  all  t.  (45) 

qcPj 

To  continue  with  our  formulation  of  flows  at  a  Junction,  we  must 
introduce  a  number  of  inequality  constraints  as  follows: 

.J(t)  *  0  ,  1-1,  2,  ...»  n;  qep^  and  all  t  (46) 

y1  (t)  «s  0  ,  i  —  1,  2 . .  pea.;  qeP.J  J  -  1,  2 . .  and  all  t  (47) 

pq  J  J 

u*  (t)  *  0,  i  -  1,  2,  ...,  n;  pea.  ;  j  -  1,  2 . .  and  all  t.  (48) 

JP  J 

It  is  difficult  to  establish  upper  bounds  for  the  rate  of  traffic 
flow  through  a  junction.  Roughly  speaking,  the  traffic  flow  at  an 
intersection  is  a  function  of  the  physical  size  of  the  intersection, 
the  cycle  of  the  traffic  light,  and  the  number  of  cars  that  are  making 
turns  at  the  intersection  thus  disrupting  the  smooth  flow  of  traffic. 

(Generally  left  turns  cause  the  greatest  difficulty.  Note  that,  in 
our  present  model,  we  have  allowed  even  a  "U  turn"  at  an  intersection). 

Before  we  formulate  upper  bound  constraints  for  the  flow  through  a 
typical  vertex  (or  junction),  v^,  we  will  define  a  few  terms.  Let 

e  yjq(c)  -  ypq(0,  pePj  ;  J  "  2 . n*  (49) 

We  define  a  weighing  factor  (a  non-negative  number)  for  every  portion 
of  the  traffic  through  a  junction.  Let  Wpq  be  the  weighing  factor 

corresponding  to  ypq(t).  <pe<*j  i  q®pj>-  For  exa®Ple»  one  mi8ht  8et 
W  ■  1  if  branches  b  and  b  corresponded  to  the  same  streets, 

pq  p  q 

(i.e.  the  traffic  corresponding  to  was  *n  a  straight 

path),  and  one  might  set  Wpq  -  2  if  ypq(t)  corresponds  to  traffic 


which  has  to  make  a  turn  to  enter  branch  (street)  b^.  With  these 
ideas  in  mind,  it  is  reasonable  to  add  the  following  constraint 


W 

pq 


y__(t) 

pq 
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peer j  ;  j  ■  1,  2,  n  and  all  t  (50) 

The  accuracy  of  our  formulation  to  a  great  extent  depends  on  the 
accuracy  of  the  above  constraint  (50).  However,  this  is  intended 
to  be  an  approximate  formulation  of  a  very  difficult  problem. 

To  finish  our  formulation,  we  need  to  specify  an  objective 
function.  To  do  this,  however,  we  need  to  describe  exactly  what  is 
the  problem.  As  in  the  case  of  the  communication  network  with  memory, 
there  seems  to  be  three  classes  of  problems  in  connection  with 
traffic  networks:  (1)  analysis  of  the  existing  capability,  (2) 
design  of  an  entirely  new  traffic  network,  and  (3)  expansion  of  the 
present  capability. 

(1)  Analysis:  We  assume  n  sources  of  traffic  are  given  for  all  t 

in  [0,  T  ],  but  the  corresponding  sink  vectors  are  not  completely 

specified.  The  structure  of  the  network  is  given  in  the  form  of 

* 

graph  G,  and  we  are  given  constants  Tj>  Mj»  Wpq»  Wp»  (Pcc*i  an<* 

qepp,  and  rj(0),  for  i  ■  1,  2,  ...,  n  and  for  j  *  1,  2,  ...,  m.* 
Then,  we  would  like  to  maximize 

T 


n  n  f  r*  , 

E  d  E  e  \  uj(t)  dt 

i-1  j-1  J  J 


(51) 


(d^'s  and  e^'s  are  0's  or  1  * s  and  they  depend  upon  the  choice  of  the 


desired  subset  of  flows  to  be  maximized  and  uz  is  the  ith  component 


* 


In  all  of  these  problems,  because  of  the  branch  delays,  we  must 
also  be  given,  z*(t)  for  tet£Tj,  (lSjSm,  LsfcJn). 


of  vector  Uj(t)  )  subject  to  constraints  (37)  through  (:>v  *  eing 
satisfied  for  all  t  in  [0,  T],  and  in  addition  the  following 
constraint  must  be  satisfied. 


E  r*(0)  + 

j-1  J 
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o 


s.(t)  2:  E 

J-1 


T 
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Uj(t)  dt  for  i  *  1,  2, 


(52) 


This  problem  is  not  quite  as  practival  as  the  corresponding 
problem  in  communication  network;  because  one  is  not  free  to  direct 
traffic  as  one  pleases,  i.e.,  the  driver  usually  picks  the  shortest 
route  to  reach  his  destination  and  he  is  not  so  concerned  about  the 
efficient  use  of  the  network. 

(2)  Design:  We  are  given  G,  s^t),  U^t),  ,  t  y  r*(0),  W  , 

(peofi,  qe^;  i  »  l,  2,  . . . ,  n,  j-1,  2,  . ..,  m,  t  in  [0,T]),and 
also  given  cost  per  unit  capacity  of  the  links  c^(i  -  1,  2,  ...  n) 
and  the  cost  of  junctions  k^pecr^,  j-1,  2,  ...,  n).  Then  we  would 
like  to  minimize 


m  *  n 

E  c  b  +  E 
i-1  1  j-1 


E 

peofj 


k  W 
P  P 


(53) 


subject  to  constraints  (37)  through  (50)  being  satisfied  for  all  t  in  [0,T], 

(3)  Expansion:  Given  are  all  of  the  quantities  in  (2)  and  also  present 

capacities  b^,  (i-1,  2,  . ..,  m),  and  W'  ,  (peofj,  j-1,  2,  ...,  n), 

*  *' 

We  would  like  to  find  b,  2:  b.  and  W  2  W'  such  that  constraints 

i  i  ,  P  P 

(37)  through  (50)  are  satisfied  for  all  t  in  [0,T]  and 


10  *  *•  ® 

E  c  (b  -  b  )  +  E  E  k  (W  -  W») 

i  i  *•  _  P  P  p 


i-1 


j-1  pcffj  P  P 


(54) 


is  minimized. 


VI  Conclusion 


There  are  two  fundamental  problems  with  respect  to  the  linear 
programming  formulation  of  communication  networks  with  memory  (as  well 
as  the  traffic  networks):  (1)  The  enormous  number  of  constraints 
which  to  say  the  least  limits  the  size  of  the  networks  that  can  be  handled 
even  with  the  fastest  available  digital  computers.  Some  aspects  of 
this  problem  were  discussed  in  Section  III.  As  it  can  be  seen, 
computation  problem  will  increase  substantially  when  one  puts  limita¬ 
tions  on  acceptable  limits  on  delay  of  message  at  each  storage  point, 

(as  discussed  in  Section  IV).  This  problem  becomes  even  worse,  when 
there  are  a  number  of  priority  classes  in  the  messages  that  are  flowing 
through  the  network.  But  these  computational  difficulties  are  to  great 
extent  inherent  in  the  problem  and,  of  course,  the  choice  of  the  model. 

(2)  The  second  problem  is  the  choice  of  a  deterministic  model.  It  is 
well  known  that  the  nature  of  such  traffic  and  sources  of  messages 
(or  traffic)  is  statistical.  The  question  is  "can  anything  be  done 
with  a  statistical  model?"  For  a  communication  network  with  direct 
traffic  (no  memory)  and  single  commodity  traffic,  Frank  and  Hakimi 
[  18,19  ]  have  presented  a  statistical  analysis  which  lead  to  grave 
computational  difficulties.  This  rules  out  the  possibility  of  the 
generalization  of  their  results  to  the  present  case,  as  a  practical 
solution.  Kleinrock  [20]  presented  a  statistical  analysis  of  message 
flow  and  delay  in  a  direct  traffic  communication  network  where  the  de¬ 
lay  time  was  due  to  the  traveling  time  in  the  branches.  Kleinrock' s 
results,  although  interesting,  is  very  difficult  to  apply  to  the 
present  problem  and  also  leads  to  serious  computational  difficulties. 
However,  since  the  memory  units  have  a  smoothing  effect  on  the  traffic 
through  the  communication  network,  it  is  more  reasonable  to  accept 
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a  deterministic  model  for  the  present  problem  than  it  is  to  accept 
a  deterministic  model  for  communication  networks  without  memory. 

It  might  be  convenient  to  use  the  following  approach  in  the  sub-opti¬ 
mum  design  of  a  communication  network  with  memory.  Let  us  assume  we 
are  given  the  initial  conditions  and  a  period  T.  The  network  N  is 
to  be  designed  to  handle  the  given  flow  specifications  over  the 
internal  [0,T].  Let  T  and  suppose  we  first  design  the  network 

which  is  capable  of  handling  the  flow  specifications  over  the 
interval  [0,T^].  Then,  using  the  contents  of  the  memory  units  at  time 
T^  as  the  new  initial  conditions,  we  modify  network  (in  a  optimum 
manner  as  in  Problem  2)  such  that  the  resulting  network  N  can  handle 
the  flow  specifications  over  the  interval  [T^T].  Repeated  use  of 
this  idea  can  help  reduce  the  computational  time.  The  same  idea  can 
be  used  (with  the  appropriate  choice  of  initial  conditions)  in  connection 
with  the  street  traffic  problem  and  the  communication  networks  with 
message  priorities.  Unfortunately,  the  resulting  realization  is  not  optimum. 
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Fig.  1  -  (a)  Vertex 


and  (b)  splitting  of  and 


introduction  of  memory  unit. 


Fig.  3  -  Representation  of  single  link  in  a  highway  network. 
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